Tracking-based illumination control system

ABSTRACT

A Light Adjustable Lens (LAL) Tracker comprises an Imaging System, for creating a LAL image by imaging a LAL implanted into an eye; and an Image Recognition System, coupled to the Imaging System, for determining a disk cross-correlator with the LAL image; determining an edge cross-correlator with the LAL image; and determining a LAL position by determining a combined cross-correlator from the disk cross-correlator and the edge cross-correlator. A Tracking-based Illumination Control System comprises the LAL Tracker for tracking a LAL implanted in an eye, including an Imaging System, and an Image Recognition System; and an Illumination Controller, coupled to the LAL Tracker, configured for determining a LAL misalignment factor, corresponding to a LAL misalignment that characterizes a misalignment of the LAL position with a LAL illumination pattern, and generating an illumination control signal in relation to the determined LAL misalignment factor.

TECHNICAL FIELD

This invention relates to imaging and illuminating light adjustablelenses, and more specifically to systems and methods to control theillumination based on the imaging and tracking of the light adjustablelens.

BACKGROUND

The techniques of cataract surgery are experiencing continuous,impressive progress. Generations of phacoemulsification platforms andmore recently introduced surgical lasers keep increasing the precisionof the placement of intraocular lenses (IOLs) and keep reducing unwantedmedical outcomes. Nevertheless, after the IOLs have been implanted, thepostsurgical healing process shifts and rotates the IOLs in anon-negligible fraction of the patients, leading to a diminished visualacuity. A new technique has been developed recently to correct ormitigate this postsurgical IOL shift. The underlying idea is to adjustthe IOLs post-surgically by applying a suitable illumination. Asdescribed, e.g. in commonly owned U.S. Pat. No. 6,905,641, to Platt etal, entitled: “Delivery system for post-operative power adjustment ofadjustable lens”, hereby incorporated by reference in its entirety, theIOLs can be fabricated from a photo-adjustable material, henceforthmaking them Light Adjustable Lenses, or LALs. After the implanted LALssettled and shifted post-surgically, the LALs can be illuminated by anirradiation system with an illumination pattern that induces a change inthe shape and possibly in the index of refraction of the LALs, such thattheir optical power is modified. The illumination pattern can be chosensuch that the induced optical power change compensates the unintendedpost-surgical shift of the LAL.

An important aspect of this process is the need to align theillumination pattern and the LAL, to ensure that the illuminationpattern causes the intended power change. The power change caused by amisaligned illumination pattern may not compensate the post-surgical LALshift effectively. Such misalignment can be caused by the patient's eyemovements, such as saccadic eye motion, breathing, and involuntarymovements by either the patient or the physician.

In some illumination procedures, the misalignment between the eye andthe illumination by the Light Delivery System, or LDD, can becompensated by the physician manually in real time. The physician canlook through the oculars of a biomicroscope of the LDD and maintain anoverlap of a presented reticle and the image of the LAL by continuouslyapplying small changes to either the position of the eye, or to theillumination pattern the LDD, or to both.

Problems of such approaches include that illumination procedures canrequire several minutes and maintaining the alignment through an entireduration of such a procedure can be difficult and tiring for thephysician. Also, maintaining the alignment is one more skill thephysicians need to master, and a lack of mastery of this skill is onemore way the procedure can result in inferior visual acuity. Therefore,there is a clear medical need to assist the physician to align theillumination pattern with the implanted LAL during the lens adjustmentprocedure. Automating any aspect of the LAL-illumination alignment canbe valuable to reduce the demand on the physician, to reduce the skillsrequired of the physician, and thus to improve the visual outcome of theadjustment procedure.

SUMMARY

The above-described medical needs can be addressed by the followingembodiments. A Light Adjustable Lens (LAL) Tracker, comprising anImaging System, for creating a LAL image by imaging a LAL implanted intoan eye; and an Image Recognition System, coupled to the Imaging System,for determining a disk cross-correlator with the LAL image; determiningan edge cross-correlator with the LAL image; and determining a LALposition by determining a combined cross-correlator from the diskcross-correlator and the edge cross-correlator.

In some embodiments, a method of tracking a Light Adjustable Lens (LAL)is comprising: creating a Light Adjustable Lens (LAL) image by imaging aLAL implanted into an eye with an Imaging System; determining a diskcross-correlator with an Image Recognition System; determining an edgecross-correlator with the Image Recognition System; and determining anLAL position by determining a combined cross-correlator from the diskcross-correlator and the edge cross-correlator, using the ImageRecognition System.

In some embodiments, a Tracking-based Illumination Control System iscomprising a Light Adjustable Lens (LAL) Tracker for tracking a LALimplanted in an eye, including an Imaging System, for creating a LALimage by imaging the LAL, and an Image Recognition System, coupled tothe Imaging System, for determining a LAL position in a reference framebased on the LAL image; and an Illumination Controller, coupled to theLAL Tracker, configured for determining a LAL misalignment factor,corresponding to a LAL misalignment that characterizes a misalignment ofthe LAL position with a LAL illumination pattern, and generating anillumination control signal in relation to the determined LALmisalignment factor.

In some embodiments, a method of operation of a Tracking-basedIllumination Control System, the method comprising the steps of trackinga Light Adjustable Lens (LAL), implanted in an eye, by a LAL Tracker,including creating a LAL image by imaging the LAL with an ImagingSystem, and determining a LAL position based on the LAL image by anImage Recognition System, coupled to the Imaging System; determining aLAL misalignment factor corresponding to a LAL misalignment thatcharacterizes a misalignment of the LAL position with a LAL illuminationpattern, by an Illumination Controller, coupled to the LAL Tracker; andgenerating an illumination control signal in relation to the determinedLAL misalignment factor by the Illumination Controller.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a Tracking-based Illumination Control System.

FIG. 2 illustrates a Light Delivery Device (LDD).

FIG. 3 illustrates an illumination alignment.

FIGS. 4A-B illustrate a Light Adjustable Lens (LAL), and its image.

FIGS. 5A-B illustrate determining a disk cross-correlator.

FIGS. 6A-C illustrate determining an edge cross-correlator.

FIG. 7 illustrates determining a combined cross-correlator.

FIG. 8 illustrates switching a template.

FIG. 9 illustrates a method of tracking a LAL.

FIGS. 10A-C illustrate a Tracking-based Illumination Control system anda method of its operation.

FIGS. 11A-C illustrate several embodiments of the LAL misalignmentfactor.

FIGS. 12A-B illustrate embodiments of an illumination control signal.

FIG. 13 illustrates an illumination-shifting, control signal.

FIG. 14 illustrates an illumination-reducing and anillumination-recompensing control signal.

DETAILED DESCRIPTION

This document describes a system that addresses the above describedmedical needs. The first part of the document describes embodiments of aLight Adjustable Tracking System and method, directed toward detectingand imaging an implanted Light Adjustable Lens (LAL), in order todetermine its position and misalignment relative to a relevant referenceframe. In the second part, a Tracking-based Illumination Control Systemis described that can either reduce the misalignment between theimplanted LAL and an illumination system, based on the determinedposition of the LAL, or can control the illumination based on themisalignment.

A misalignment of the illumination system, in particular its LightDelivery Device (LDD) with the LAL is of high importance because amisaligned illumination can adjust the optical properties of the LAL inan unplanned manner, as well as lead to undesirable outcomes. Therefore,aligning the illumination with the LAL is of substantial medicalbenefit. The here-described system is configured to assist the operatorof the illumination system to improve the alignment between theillumination system and the LAL. This assistance allows the operator,typically a physician, to improve and maintain the alignment with ahigher precision. Operating the described systems therefore require lesseffort and skill, so that the physician can focus on the other aspectsof the illumination process. All these aspects of the described systemsand methods lead to medical outcomes with better visual acuity.

Light Adjustable Lens Tracking System and Method

FIGS. 1-9 illustrate a Light Adjustable Lens (LAL) Tracker 100,comprising an Imaging System 200, for creating a LAL image 210 byimaging a LAL 10 implanted into an eye; and an Image Recognition System300, coupled to the Imaging System 200, for determining a diskcross-correlator 301 with the LAL image 210; determining an edgecross-correlator 302 with the LAL image 210; and determining a LALposition 304 by determining a combined cross-correlator 303 from thedisk cross-correlator 301 and the edge cross-correlator 302. The LALTracker 100 can output the LAL position 304 toward an IlluminationController 400, which in turn can generate an illumination controlsignal 430. This illumination control signal 430 can prompt either anoperator, or a Light Delivery Device (LDD) 500 for either a responsiveaction, or a realignment, as described in detail later.

In some embodiments, the Imaging System 200 images the LAL 10 using aninfrared wavelength imaging light. During the illumination procedure,various light sources can be present. Besides the ambient light sources,often eye-fixation lights, or Light Emitting Diodes (LEDs), and 4-8illumination LEDs are employed to make the eye well-lit for thephysician. All these light sources reflect not only from the cornea, butfrom the inner layers of the eye, causing so-called Purkinjereflections. These numerous Purkinje reflections can be quitedisorienting and confusing from an imaging point of view. Since most ofthese illumination and fixation lights operate only in the visible rangeand have no infrared component, some embodiments of the Imaging System200 prevent imaging confusion by using infrared light for the imaging.

Since the Imaging System 200 is providing real-time image of the eye, insome embodiments video imaging systems can be employed. The inherentnoise of the imaging process can be reduced by creating an image viaaveraging a few video frames, such as averaging 2-10 frames. The framerate of these video imaging systems can be suitably chosen: it can bebelow 20 frame/sec, about 20 frames/sec, or above 20 frames/sec.

FIG. 2 illustrates an embodiment of the Light Delivery Device (LDD) 500.The left panel shows a patient-facing image of the LDD 500. Theillumination is applied through the LDD objective 501. The LAL Tracker100 can be implemented fully or partially integrated with the LDD 500.For example, an optical portion, or an imaging portion of the LALTracker 100, or both can be co-housed with the optics of the LDD 500,while a computer portion of the LAL Tracker 100 can be housedseparately.

The right panel shows that, in some embodiments, the LDD 500 can includea light source 510, that can be a UV light source, a mercury arc-light,an LED, an LED array, a laser, a scanned light source, a pulsed lightsource, or a continuous-wave light source. The light source 510 cangenerate a light 520 that is directed to a patterning system. In someembodiments, this patterning system can be a Digital Mirror Device (DMD)530. The DMD 530 can include a large array of micro-mirrors 532(i,j)that can be individually controlled. In a standard DMD arrangement, themirrors 532(i,j) can be switched between an on and an off position. Theon-mirrors 532 deflect the incoming light 520, the off-mirrors 532 letthe light 520 pass by. Many other embodiments of a patterning system arealso possible, including transmission-controlled embodiments, LCD-basedembodiments. deformable mirrors, and actuated mirrors. All theseembodiments can deflect, or redirect, the generated light 520 as anillumination 540 with an illumination pattern 550.

FIG. 3 illustrates the alignment of the LAL 10 with the illumination 540with the illumination pattern 550. The illumination pattern 550 is shownas a Gaussian-like pattern, typically centered in the reference frame412 as a function of a radial distance from an optical axis. Haptics 20of the LAL 10 are also shown. The optical axis can be the optical axisof the LDD 500. In some embodiments, the illumination pattern 550 may beadjustable. These embodiments may allow the shifting of the illuminationpattern 550 off the optical axis of the LDD 500.

The Imaging System 200 can create the LAL image 210. This can be in anocular of a biomicroscope of the LDD 500. Other embodiments can employ aseparate video microscope, or video display. Aligning the illumination540 and its illumination pattern 550 with the LAL 10 can be assisted bya reference frame 412, as e.g. provided via a presented, or apparent,reticle 413.

Many embodiments are possible here. The reference frame 412, sometimescalled the reference system 412, can be a reference system of, orreferenced to, the Imaging System 200, the Image Recognition System 300,the Illumination Controller 400, or the LDD 500. Some, or all of thesesystems 200-500 can share some or all of their optical pathway, and thusmay share their reference system 412. The reference frame/system 412 canbe presented for the operator, typically a physician, in a convenientmanner via the reticle 413. The reticle 413 can be a circle, centered atthe origin of the reference frame 412. The circle can be continuous orsegmented. It can be a set of concentric circles. The reticle 413 canalso be a crosshair, a square, or a combination of the previouslydescribed embodiments. The reticle 413, and thus the reference frame412, can be coupled into the optical system of the Light Delivery Device500, e.g., via a beam splitter and a mirror that reflects differently inthe visible and the IR. In other embodiments, the reticle 413, and thusthe reference frame 412, can also be electronically generated in the LALTracker 100, or the Illumination Controller 400. In all of theseembodiments, the reticle 413, and thus the reference frame 412, can beindicative of a center of the illumination pattern 550 of the LDD 500.As described before, embodiments with different choices of the referenceframe 412 and reticle 413 can all be useful for determining themisalignment of the LAL position 304 relative to the illuminationpattern 550.

In these embodiments, one of the tasks is to align the LAL 10 with thereference frame 412. As mentioned before, this can be achieved byadjusting or shifting either the illumination pattern 550, or the eye,or both. In some typical embodiments, the center of the LAL 10 can bealigned with the center of the reference frame 412. In otherembodiments, the perimeter of the LAL 10 can be aligned with the reticle413. Many analogous alignment techniques can be implemented as well.

The LAL alignment can be achieved by the physician manually moving orrotating the eye, while watching the LAL position 304 on the LAL image210. In some embodiments, the physician can place a contact lens on theeye and rotate the eye by manually manipulating the contact lens.

The LAL Tracker 100 can be set up to assist, and to partially automatethis alignment process by utilizing the Image Recognition System 300.This Image Recognition System 300 can be formed for determining the LALposition 304 relative to the reference system 412. In some typicalembodiments, the LAL position 304 refers to the position of the centerof the LAL 10. Once the Image Recognition System 300 determined the LALposition 304, the operator can improve the alignment of the illuminationpattern 550 with the LAL 10 by adjusting the eye, the LDD, or both, toalign the center of the illumination pattern 550 with the determined LAL(center) position 304.

In other embodiments, the Image Recognition System 300 canelectronically and directly prompt the illumination of the LDD 500 withthe illumination control signal 430 for a responsive action once amisalignment has been detected, as described below.

The described techniques and systems can minimize and manage the LAL-LDDmisalignment accurately if the LAL position 304 is determinedaccurately. FIGS. 4-7 describe in detail how the LAL Tracker 100 candetermine the LAL position 304 accurately.

FIGS. 4A-B illustrate the context of this imaging challenge. FIG. 4Ashows that typical embodiments of the LAL 10 include a central lens 11,which has a curvature on both sides, and accordingly has an opticalrefractive power. Typical values of this refractive power are in the10-30 diopter (D) range. A majority of the LALs have optical powerswithin a few diopter range around 20 D. The central lens 11 has a strongoptical power and thus focuses light very effectively, and therefore ittypically shows up as a bright disk 12 in the LAL image 210, as shown inFIG. 4B.

The central lens 11 is surrounded by a central lens-edge 13, which showsup as a bright-disk edge 14 in the LAL image 210. This central lens-edge13 can be surrounded by a rim 16, which typically has no associatedoptical power, and therefore it is distinctly less bright than thebright disk 12 in the LAL image 210. The rim 16 is bounded by a rim-edge18. In relevant embodiments, the LAL 10 can also include a UV absorbingback-layer 19.

FIG. 4B shows that the LAL image 210 typically also captures an image ofthe haptics 20-1 and 20-2. The haptics 20-1/20-2 are most oftenimplemented as a pair. The LAL image 210 is shown as pixillated in itsmost typical implementation, as a video image frame of a video imagingsystem that can involve a CCD camera. In this implementation, the ImageRecognition System 300 is configured to determine the LAL position 304as a pixel position in the reference frame 412, that can be referenced,or translated into the pixel positions of the video imaging system.

FIGS. 5-7 illustrate in detail the process of determining the LALpositions 304. FIG. 5A illustrates that the Image Recognition System 300can be configured for determining the disk cross-correlator 301 as across-correlation function between a disk-template 312 and the LAL image210, wherein the disk-template 312 is an expected image of the brightdisk 12, generated by the central lens 11 of the LAT. 10. Since thespecifics of the optical system of the Imaging System 200 and the LAL 10are known, the disk-template 312 as the expected image of the LAL 10 canbe constructed quite accurately. FIG. 5B illustrates that in someembodiments the cross-correlation function includes a disk weightingmatrix 314. The above-mentioned cross-correlators and cross-correlationfunctions can be normalized. In equations, the above can be expressedas:

$\begin{matrix}{{C_{m,n} = \frac{\sum_{i,j}{I_{{m + i},{n + k}}^{\prime}T_{i,j}^{\prime}W_{i,j}}}{\sqrt{\sum_{i,j}{\left( {I_{{m + i},{n + j}}^{\prime}W_{i,j}} \right)^{2}{\sum_{i,j}\left( {T_{i,j}^{\prime}W_{i,j}} \right)^{2}}}}}}{{wherein}\text{:}}} & (1) \\{I_{i,j}^{\prime} = {{I_{i,j} - {{\langle{W_{i,j}I_{i,j}}\rangle}T_{i,j}^{\prime}}} = {T_{i,j} - {\langle{W_{i,j}T_{i,j}}\rangle}}}} & (2)\end{matrix}$

In Eq. (1), I_(m+i,n+j) represents the value of the LAL image 210 in the(m+i,n+j) pixel, T_(i,j) represents the value of the disk template 312in the (i,j) pixel, and W_(i,j) represents the value of the weightingmatrix 314 in the (i,j) pixel. The pixel-by-pixel sum of the productconvolution of the I, T and W matrices defines the cross-correlationfunction C_(m,n). The square roots in the denominator are thenormalization factors for the I and T matrices. In Eq. (2). theW-weighted averages of the I and T matrices have been factored out todefine the I′ and T′ matrices. In FIGS. SA-B, the <A*B> and <A*B*C>notations represent convolving the A and B, and the A, B, and C matriceson an element-by-element basis, and then summing up their products, ase.g. indicated in Eq. (1).

The LAL image 210 I_(m+i,n+j) is expected to take the shape of, or fit,the disk template 312 T_(i,j). An unknown of this fitting is the LALposition 304 in the reference frame 412. In some embodiments, the disktemplate 312 T_(i,j) is centered with the reference frame 412. The LALposition 304 can be determined by assuming that the LAL image 210 I isshifted relative to the disk-template 312 T by a shift vector (m,n), andthen determining the normalized cross-correlator C_(m,n) by scanningacross the space of all reasonable values of this shift-vector (m,n)._(m,n) expresses how well the shifted image I_(m+i,n+j) is representedby the centered disk template 312 T_(i,j). The cross correlationfunction C_(m,n) is expected to show a maximum when the shift vector(m,n) coincides with the LAL (center) position 304. Of course, inanalogous embodiments, the LAL image 210 I can be kept centered, and theshift of the disk-template 312 T can be scanned. In yet otherembodiments, both the LAL image 210 I and the disk template 312 T can bescanned. The shared aspect of these approaches is that the center of theLAL image 210 I and the center of the disk template 312 T are scannedrelative to each other.

This scanning can be a straightforward raster scan across the entire(reasonable) position space. In other embodiments, it can be a directed,searching scan, using some variant of a search process, such as agradient descent search, or a conjugate gradient method. Many othersearch methods are known in the art and can be used.

In some embodiments, optionally a disk weighting matrix 314 W_(i,j) canbe included to improve the efficiency and can reduce the noise of thisprocedure by eliminating, or de-weighting, those regions from theprocedure that are well-separated from the bright-disk edge 14 and therim-edge 18, and thus are not expected to contribute meaningfully tothis image recognition process. For example, the disk-weighting matrix314 W_(i,j) can be a disk or a ring with some width around the expectedbright disk-edge 14.

Several other embodiments of the disk cross-correlator 301, edgecross-correlator 302, and combined cross-correlator 303 can be used aswell. In some technical descriptions, the weighting is referred to asmasking, and thus, the weighting matrix 314 W_(i,j) can also refer to amasking matrix 314 W_(i,j). Further, a wide class of the here-describedimage recognition processes is often referred to as “template matching”.Several template matching techniques are described on the website “OpenSource Computer Vision”, seven pages of which were captured at the timeof filing this patent document, submitted herewith and incorporated inits entirety. Embodiments of such image recognition methods by templatematching include CV_TM_SQDIFF; CV_TM_SQDIFF_NORMED; CV_TM_CCORR:CV_TM_CCORR_NORMED; CV_TM_CCOEFF; and CV_TM_CCOEFF_NORMED. Each of thistemplate matching techniques can be practiced by the Image RecognitionSystem 300. Another class of embodiments of the cross-correlators301-303 can involve Hough transforms, of the line, circle orellipse-based variety, or generalized Hough transforms. These Houghtransforms can involve transforming the raw image data from acontinuous, or analog grey scale to a single bit per pixelrepresentation. In some cases it can involve a voting procedure in aparameter space.

FIG. 5B shows the disk cross-correlator 301 C_(m,n) that emerges fromthe just-described procedure. The disk cross-correlator 301 C_(m,n)clearly exhibits a maximum, that is the most likely LAL position 304.While this disk cross-correlator 301 has a clear maximum, thecorrelation function around the maximum is relatively smooth, andtherefore, the LAL position 304 is not defined very sharply by theprocedure based on the disk template 312 alone. Therefore, employingimprovements that sharpen this maximum can enhance the efficiency of thedetermination of the LAL position 304.

FIGS. 6A-B show such an improvement. The Image Recognition System 300can be further configured for creating a LAL gradient image 320 bydetermining a gradient of the LAL image 210:

G=|∇I|  (3)

Here, I continues to denote the value of the LAL image 210. The LALgradient image 320, denoted by G, is determined as the magnitude of thegradient vector of the image I. Taking the gradient captures the spatialchange of the LAL image 210 very efficiently, as seen from the sharpnessof the white contours, or lines, in the right panel of FIG. 6A.

FIG. 6B illustrates that the rest of the method of determining the edgecross-correlator 302 can be implemented analogously to the method ofdetermining the disk cross-correlator 301, wherein the gradient image Gtakes the role of the image I. An edge-template 330 T_(i,j) can bedefined that includes the most relevant expected aspects of the LALgradient image 320: a well-defined rim-edge template 332, and a brightdisk-edge template 334, corresponding to the bright disk-edge 14,generated by the central lens-edge 13 of the LAL 10, and a haptic-edgetemplate 336, corresponding to at least one haptic 20 of the LAL 10. Fora more streamlined nomenclature, the contours that correspond to thehaptics 20 in the LAL gradient image 320 and in the edge-template 330,are also referred to as a haptic-edge gradient image 326 and ahaptic-edge template 336. The haptic-edge gradient images 326, and thehaptic-edge templates 336 of the two haptics 20-1 and 20-2 arecorrespondingly labeled as -1 and -2. The edge cross-correlator 302 isdetermined as the cross-correlation function formed from theedge-template 330 T_(i,j) and the LAL gradient image 320 G_(m+i,n+j).

It is noted that, as seen in the LAL gradient image 320 in FIG. 4B, andin the second panels of FIG. 6A and FIG. 6B, the LAL gradient image 320also includes an approximately circular image of the capsulorhexis, aswell as the circular image of the aperture of the optics. In some of thehere-described methods, these two, roughly circular images are not used,or referenced.

Finally, similarly to the technique described in FIGS. 5A-B, thecross-correlation function can optionally include an edge weightingmatrix 340 W, to reduce the noise from the less-relevant portions of theLAL gradient image 320. The correlation function of these threefunctions. the LAL gradient image 320, the edge-template 330, andoptionally the edge weighting matrix 340 yields the edgecross-correlator 302, as shown in FIG. 6B.

FIG. 6C illustrates a technical aspect of calculating the edgecross-correlator 302. While the edge-template 330 is built on theexisting knowledge that the LAL gradient image 320 is expected to showthe image of two haptics 20-1/2, the orientation of these two haptics20-1/2 is not known. One way to handle this uncertainty is not to use asingle haptic-edge template 336, as its orientation will typically notline up with the orientation of the actual haptics 20-1/2. Instead, toconstruct the correlation function of the LAL gradient image 320 with ahaptic-edge template 336 oriented into a specific direction, and in thelikely case of the correlation function indicating limited correlations,repeatedly rotating the haptic-edge template 336 by an incremental angle337-i and re-calculating the correlation function until the bestcorrelation is achieved. This incremental angle can be a few degrees inthe 0-5 degrees range, in some embodiments, the incremental angle 337-ican be about 2 degrees.

FIG. 6B illustrates that the edge cross-correlator 302 also exhibits apeak in the reference frame 412, as did the disk cross-correlator 301,but this peak is much sharper, and thus predicts the LAL position 304with higher confidence.

FIG. 7 illustrates the next step of the procedure: generating thecombined cross-correlator 303 as product of the disk cross-correlator301 and the edge-cross-correlator 302. Visibly, this combinedcross-correlator 303 exhibits an even sharper peak than either the diskcross-correlator 301, or the edge cross-correlator 302, thus enablingthe determination of the LAL (center-) position 304 with even higherconfidence and accuracy in the reference frame 412. This increasedaccuracy demonstrates the benefit of combining the information capturedby the two cross-correlators 301 and 302 separately.

It is noted that the combined cross-correlator 303 in the abovedescribed embodiments can be calculated in different ways. A usefulapproach is to compute it as an element-wise product of the diskcross-correlator 301 and the edge cross-correlator 302. Optionally, thedisk cross-correlator 301 and the edge cross-correlator 302 can beweighted differently. This can be achieved, for example, by raising atleast one of the two correlation functions 301 and 302 to a powerdifferent from 1.

As mentioned, the Image Recognition System 300 can determine the LALposition 304 by determining a position of a maximum of the combinedcross-correlator 303. Beyond that, the LAL Tracker 100 can be configuredfor assigning a confidence indicator CI to the determined LAL position304 based on a value of the combined cross-correlator 303 correspondingto the maximum. In other embodiments, the curvature of the combinedcross-correlator 303, measuring how sharp is the maximum, can beadditionally factored into the confidence indicator CI.

FIG. 8 illustrates that at the start of the image recognition process,the confidence indicator CI starts out with low values, since thescanning over the possible shift vectors (m,n) typically startssomewhere away from the maximum of the combined cross-correlator 303C_(m,n). The confidence indicator CI typically increases as the shiftvector (m,n), the relative shift between the LAL image 210 and the disktemplate 312, and the shift between the LAL gradient image 320 and theedge template 330, is scanned across the search space, and the scanningsearch finds higher and higher values of the combined cross-correlator303 C_(m,n). A further factor causing delay is the rotational search ofthe haptic-edge template 336, with the incremental angle 337-i. As thesearch process progresses, the confidence indicator CI can increaseabove a confidence threshold. This threshold can be chosen judiciously,so that once CI exceeds this threshold, the determined LAL position 304can be trusted.

With today's powerful computers, exceeding this CI threshold can beachieved quite fast. In some relevant embodiments, the combinedcross-correlator 303 can rise above a reliable confidence indicator CIin 10-50 ms, in some cases in 20-30 ms. Thus, in embodiments where thevideo frame time is 50-100 ms, i.e. the frame rate is 10-20 frames/sec,the LAL tracker 100 can determine the LAL position 304 with highconfidence for each frame.

Once CI crosses the confidence threshold, and the LAL position 304 isdetermined with a high confidence indicator CI, a notable improvement ofthe search process can be implemented. The Image Recognition System 300can be configured for switching from the disk-template 312 and theedge-template 330 to a LAL image template 350 that is based on the LALimage captured at the maximum of the combined cross-correlator 303C_(m,n). After this switch to the LAL image template 350, the LALposition 304 can be determined in the subsequent video frames bydetermining the combined cross-correlator 303 of the LAL image 210 withthis captured LAL image template 350. Using such a LAL image template350 can increase the confidence indicator CI to even higher values.

The above description characterized the LAL Tracker 100 and a method howit determines the LAL position 304. FIG. 9 summarizes this method 360for completeness. This method 360 of tracking a Light Adjustable Lens 10can include:

Generating 361 of the LAL image 210 by imaging the LAL 10 implanted intoan eye with the Imaging System 200;

Determining 362 the disk cross-correlator 301 with the Image RecognitionSystem 300;

Determining 363 the edge cross-correlator 302 with the Image RecognitionSystem 300; and

Determining 364 the LAL position 304 by determining the combinedcross-correlator 303 from the disk cross-correlator 301 and the edgecross-correlator 302, using the Image Recognition System 300.

The method 360 can also include controlling an illumination 540 of theLAL by the Illumination Controller 400 and by the Light Delivery Device500, based on the determined LAL position 304.

Tracking-Based Illumination Control System

FIGS. 10-14 describe a Tracking-based Illumination Control System 600and its operations. FIG. 10A illustrates that the LAL Tracker 100 can becoupled to the Illumination Controller 400 that can be configured forreceiving the determined LAL position 304, and for generating anillumination control signal 430 based on the received LAL position 304.Further, the Illumination Controller 400 can be coupled to the LightDelivery Device 500 that is configured for receiving the illuminationcontrol signal 430 from the Illumination Controller 400, and forilluminating the LAL 10 in relation to the received illumination controlsignal 430.

The LAL Tracker 100, its Imaging System 200 and Image Recognition System300 and the Illumination Controller 400 together can be parts of theTracking-based Illumination Control System 600 as described in moredetail next. This Tracking-based Illumination Control System 600 can becomprising: the Light Adjustable Lens (LAL) Tracker 100, for tracking aLAL 10 implanted in an eye, including the Imaging System 200, forcreating a LAL image 210 by imaging the LAL 10, and the ImageRecognition System 300, coupled to the Imaging System 200, fordetermining the LAL position 304 in a reference frame 412, based on theLAL image 210 and the combined cross-correlator 303; and theIllumination Controller 400, coupled to the LAL Tracker 100, configuredfor determining a LAL misalignment factor 420 corresponding to a LALmisalignment 410 that characterizes a misalignment of the LAL position304 with a LAL illumination pattern 550, and for generating theillumination control signal 430 in relation to the determined LALmisalignment factor 420. In some embodiments of the Tracking-basedIllumination Control System 600, the Illumination Controller 400 can beintegrated with at least one of the Image Recognition System 300 and theLight Delivery Device 500; in some cases, with both. In someembodiments, the Illumination Controller 400 can send the illuminationcontrol signal 430 to the LDD 500, in others, to an operator of theTracking-based Illumination Control System 600 and the LDD 500, toprompt some kind of action, or a realignment of the LAL position 304with a LAL illumination pattern 550.

FIG. 10B illustrates a typical case of the LAL misalignment 410. In atypical embodiment, the LAL position 304 within the reference frame 412can be simply identified as the LAL misalignment 410, since theillumination pattern 550 is typically centered in the reference frame412. In some embodiments, it may be possible that the illuminationpattern 550 is de centered relative to the reference frame 412, or thatthe optical axis of the Imaging System 200 is not aligned with thereference system 412, or that the imaging System 200 has a partiallydistinct optical system relative to the LDD 500, and the two are notcalibrated together. In these embodiments, the LAL misalignment 410 canbe identified as the relative misalignment between the LAL position 304and the de-center of the illumination pattern 550.

In yet further embodiments, the reference frame 412 can be alsoreferenced to at least one of the Imaging System 200, the ImageRecognition System 300, the Illumination Controller 400, and a LightDelivery Device 500, some of which may not be calibrated together. Theresulting de-center of the illumination pattern 550 can be used as acorrection for the computation of the relation between the LAL position304 and the LAL misalignment 410. As described before, in theTracking-based Illumination Control System 600, the reference frame 412can be represented by a physical reticle 413, a projected reticle 413,or an electronically generated reticle 413.

FIG. 10C illustrates a method 601 of operation of the Tracking-basedIllumination Control System 600. The method 601 can comprise the stepsof:

Tracking 610 a Light Adjustable Lens (LAL) 10, implanted in an eye, bythe LAL Tracker 100, including

-   -   generating 612 the LAL image 210 by imaging the LAL 10 with the        Imaging System 200, and    -   determining 614 the LAL position 304 based on the LAL image 210        by the Image Recognition System 300, coupled to the Imaging        System 200;

Determining 620 the LAL misalignment factor 420, corresponding to theLAL misalignment 410 that characterizes a misalignment of the LALposition 304 with the LAL illumination pattern 550, by the IlluminationController 400 that is coupled to the LAL Tracker 100; and

Generating 630 the illumination control signal 430 in relation to thedetermined LAL misalignment factor 420 by the Illumination Controller400.

In embodiments, where the Image Recognition System 400 and theIllumination Controller 400 are at least partially integrated, thedetermining 614 of the LAL position 304 by the Image Recognition System400 and the determining 620 of the LAL misalignment factor 420 by theIllumination Controller 400 can be a correspondingly integrated step.

FIGS. 11A-C illustrate the determining 620 of the LAL misalignmentfactor 420 based on the LAL misalignment 410. In some embodiments, theLAL misalignment factor 420 is simply the LAL misalignment 410; inothers, it represents, or converts, the LAL misalignment 410 into a formthat captures the medical impact of the LAL misalignment 410 in amedically useful and actionable manner

In FIG. 11A, the left panel shows the X and Y coordinates of the LALposition 304 as a function of time. (a) In simple embodiments, the LALmisalignment factor 420 can simply be the LAL misalignment 410, ascaptured by its X and Y coordinates. For example, the LAL misalignmentfactor 420 can be the magnitude of the LAL misalignment 410. When theillumination pattern 550 is centered in the reference frame 412, the LALmisalignment 410 itself is further simplified into the LAL position 304.When the illumination pattern 550 is de-centered relative to thereference frame 412, then the de-center of the illumination pattern 550is to be combined with the LAL position 304 to determine the LALmisalignment 410, which can then be identified as the LAL misalignmentfactor 420.

(b) The central panel of FIG. 11A indicates that a second class of theLAL misalignment factor 420 can be a retinal irradiance 422, theirradiance experienced by the retina during the illumination 540. Aslong as the LAL 10 is not misaligned with the illumination pattern 550,the retinal irradiance 422 is very small, as the LAL 10 contains astrongly UV absorbing material, as well as a UV absorbing back-layer 19that attenuate a very high percentage of the incident illumination 540.This class of the LAL misalignment factor 420 captures that when the LALmisalignment 410 increases, the first about 0.20-0.25 mm does notincrease the retinal irradiance either because the rim 16 of the LAL 10still absorbs the misaligned illumination 540. However, once the LALmisalignment 410 exceeds this 0.20-0.25 mm rim-related tolerance, theillumination 540 starts to pass by the illumination-absorbing LAL 10 andpropagates to the retina unattenuated, thereby exposing the retina to anincreasingly higher irradiance. This poses an increasing impact from amedical standpoint. Thus, choosing the retinal irradiance 422 as the LALmisalignment factor 420 better captures the medical effect of the LALmisalignment 410, as it includes the threshold-like onset of retinalirradiance 422 as a function of the LAL misalignment 410.

(c) FIG. 11B illustrates yet another embodiment. Medical, studiesindicate that the impact of two illuminations that have the sameradiance, but different wavelengths, can have very different medicalimpact on the retina. This is largely due to the fact that the photonsof the shorter wavelength illumination carry more energy, and thus canimpact the chemical bonds of the light-sensitive retina more profoundly.This wavelength-dependence can be captured by an “aphakic photochemicalhazard weighting function” A(λ), shown in FIG. 11B. As an example, anillumination at a wavelength of λ=350 nm poses more than 5 times thephotochemical hazard than an illumination with the same irradiance at awavelength of λ=450 nm. To capture this strong wavelength dependence ofthe medical impact, an embodiment of the LAL misalignment factor 420 canbe a hazard-weighted retinal irradiance 424, that is the retinalirradiance 422 weighted, or multiplied, by the aphakic photochemicalhazard weighting function A(λ).

(d) The right panel of FIG. 11A shows a fourth embodiment of the LALmisalignment factor 420, a cumulative dose 426. The cumulative dose 426can be constructed by integrating the retinal irradiance 422, or thehazard-weighted retinal irradiance 424 over the illumination time. Thiscumulative dose 426 captures not just the momentary retinal irradiance422, or hazard-weighted retinal irradiance 424, but the cumulativeirradiated energy that impacted the retina over the illumination time.

The cumulative dose 426 will be illustrated by comparing two particularillumination procedures. FIG. 11A, left panel illustrates anillumination procedure during which the time dependent LAL misalignment410 remained limited. The right panel shows that accordingly, thecumulative dose 426 remained below a threshold 428 throughout the entireillumination procedure.

FIG. 11C, left panel illustrates a different illumination procedureduring which the time dependent LAL misalignment 410 developed a smallmisalignment around t˜30 sec. and substantial misalignments around t˜100sec. Such substantial misalignments can be caused e.g. by an involuntarymovement of the patient's eye, or other effects. The right panel showsthat these misalignments induced a small spike around t˜30 sec and largespikes before and after t˜100 sec in the cumulative dose 426. Thedescribed four embodiments (a)-(d) of the LAL misalignment factor 420all can be used to characterize the LAL misalignment 410.

In any of the embodiments (a)-(d), one role of the LAL misalignmentfactor 420 is to indicate if an undesirable level of the LALmisalignment 410 developed between the LAL 10 and the illuminationpattern 550. Should the LAL misalignment factor 420 indicate such anundesirable level of the LAL misalignment 410, the IlluminationController 400 can generate a corrective illumination control signal430. This illumination control signal 430 can be directed to thephysician operating the LDD 500, or toward the Light Delivery Device500. For example, in embodiment (d), as shown in the right panel of FIG.11C, once the cumulative dose 426 reaches the threshold 428, theIllumination Controller 400 can generate a responsive illuminationcontrol signal 430. In embodiment (a), where the LAL misalignment factor420 is simply the LAL misalignment 410, the illumination control signal430 can be generated when the LAL misalignment 410 exceeds acorresponding threshold. In embodiment (b), where the LAL misalignmentfactor 420 is the retinal irradiance 422, then the illumination controlsignal 430 can be generated when the retinal irradiance 422 exceeds athreshold. And in embodiment (c), the illumination control signal 430can be generated, when the hazard-weighted retinal irradiance 424exceeds a threshold.

FIGS. 12A-B show that in the generating step 630 of the method 601 inFIG. 10C, the Illumination Controller 400 can be configured forgenerating the illumination control signal 430 in response to thedetermined LAL misalignment factor 420 exceeding a threshold. In otherembodiments, a smoother ramp can be used instead of the sharp threshold.For example, the illumination control signal 430 can track, or beproportional to the LAL misalignment factor 420.

FIG. 12A illustrates embodiments, when the illumination control signal430 is sent by the Illumination Controller 400 to an operator of the LDD500 or the Tracking-based Illumination Control System 600. FIG. 12Billustrates embodiments, when the illumination control signal 430 issent by the Illumination Controller 400 to the LDD 500.

FIG. 12A shows that the generating the illumination control signal 430can have many different embodiments. In a step 631, the threshold is awarning threshold and the illumination control signal 430 is a warningsignal 431, generated by the Illumination Controller 400 when the LALmisalignment factor 420 exceeds the warning threshold. The warningsignal 431 can be generated by at least one of a haptic alarm, an audioalarm, a video alarm, a temperature alarm, a vibrating alarm, and amechanical alarm for the system operator, typically a physician. Forexample, in an embodiment where the LAL misalignment factor 420 is thecumulative dose 426, if during an illumination procedure the cumulativedose 426 exceeds the (warning) threshold 428, then the IlluminationController 400 can generate an audio alarm or a vibrating alarm as thewarning signal 431 for the operating physician to prompt a correctiveaction.

In a step 632, the threshold can be an operator-action threshold and theillumination control signal 430 can be an operator-action signal 432,generated by the Illumination Controller 400, when the LAL misalignmentfactor 420 exceeds the operator-action threshold. In these embodiments,the operator-action signal 432 can correspond to an operator instructionfor at least one of reducing an intensity of the illumination 540,stopping the illumination 540, reducing the LAL misalignment 410 byrotating the eye; or shifting the illumination pattern 550 to reduce theLAL misalignment 410. For example, the operator-action signal 432 can bea visual operator instruction to stop the illumination because thecumulative dose 426 exceeded its threshold 428. Optionally, the operatorinstruction can also involve displaying a proposed corrective shift forthe illumination pattern 550 of the LDD; in other cases, a proposedrotation of the eye.

FIG. 12B shows that some embodiments of the generating step 630 caninclude step 633, where the Illumination Controller 400 can beconfigured for transmitting the illumination control signal 430 to theLight Delivery Device 500 that is configured for illuminating the LAL 10with the illumination pattern 550. In these embodiments, the correctiveaction can be carried out by the LDD 500, under the control of theoperating physician.

In a step 634, the threshold can be a reduction threshold and theillumination control signal 430 can be an illumination-reduction controlsignal 434, indicating that the LAL misalignment factor 420 exceeded areduction threshold. In these embodiments, instead of prompting theoperator for a responsive action, the Light Delivery Device 500 itselfcan be configured for reducing an intensity of the illumination 540 inresponse to the illumination-reduction control signal 434, possiblyunder the control of the operator.

In a step 635, the threshold can be a stopping threshold and theillumination control signal 430 can be an illumination-stopping controlsignal 435, indicating that the LAL misalignment factor 420 exceeded thestopping threshold; and the Light Delivery Device 500 can be configuredfor stopping the illumination 540 in response to theillumination-stopping control signal 435, optionally under the controlof the operating physician.

In yet other embodiments, e.g., in step 636, the threshold can be ashifting threshold and the illumination control signal 430 can be anillumination-shifting control signal 436, indicating how theillumination pattern 550 is to be shifted in response to the LALmisalignment factor 420 having exceeded the shifting threshold; and theLight Delivery Device 500 can be configured for shifting theillumination pattern 550 according to the illumination-shifting controlsignal 436.

FIG. 13 illustrates this step 636 is some detail. The left paneldescribes an embodiment where the illumination pattern 550 is centeredrelative to the reference frame 412. The LAL Tracker 100 can determinethe continuously changing LAL position 304 in real time and forward itto the Illumination Controller 400. Once the LDD 500 started theillumination of the LAL, the Illumination Controller 400 can determinethe time-dependent LAL misalignment factor 420 from the LAL position304, which in the present case can be the cumulative dose 426. At timet, shown in FIG. 13, a shift of the LAL 10 induced a LAL misalignment410, and the Illumination Controller 400 records a rapidly risingcumulative dose 426. Once this cumulative dose 426 exceeds a shiftingthreshold, the Illumination Controller 400 sends anillumination-shifting control signal 436 to the LDD 500. Thisillumination-shifting control signal 436 can include a warning signal tothe physician, and a suggested illumination pattern shift 570 for theLDD 500. Optionally, the illumination control signal 430 can alsoinclude an illumination-stopping signal 435. Based on the calculationsof the Illumination Controller 400, if the LDD 500 itself shifts theillumination pattern 550 with this suggested illumination pattern shift570, the LAL misalignment factor 420 can be brought under control, andthe cumulative dose 426 will stop rising further. Once the physicianauthorizes the proposed illumination pattern shift 570, the LDD 500 canexecute the proposed illumination pattern shift 570. In some cases,there can be a coordinated response: the physician can rotate the eyeand the LDD 500 can simultaneously shift the illumination pattern 550,and these two simultaneous actions together can execute the proposesillumination pattern shift 570. Once the proposed illumination patternshift 570 has been executed, the LDD 500 can continue or resume theillumination. What was just described for this specific case of step 636can be implemented in many other embodiments.

In embodiments, where the illumination control signal 430 includes anillumination-stopping signal 435, the Tracking-based IlluminationControl System 600 can also be configured for determining that the LALmisalignment factor 420 has been reduced below a resume-illuminationthreshold in response to a preceding illumination control signal 430;and for generating an illumination-resume control signal in relation tothe reduced LAL misalignment factor 420.

In the embodiments, where the LDD 500 stops the illumination 540 whilethe LAL misalignment 410 is reduced, the cumulative dose 426 may beintegrated only over the time when the LDD illumination 540 is actuallyapplied. Accordingly, the integration time can be interrupted.

Returning to FIG. 10C and FIG. 12A, in the method 601 of operating theTracking-based Illumination Control System 600, the generating 630 cancomprise the step 631 of generating a warning signal 431 as theillumination control signal 430 by the Illumination Controller 400, whenthe LAL misalignment factor 420 exceeds a warning threshold.

In other embodiments, the generating 630 can comprise the step 632 ofgenerating an operator-action signal 432 as the illumination controlsignal 430 by the Illumination Controller 400, when the LAL misalignmentfactor 420 exceeds an operator-action threshold, wherein theoperator-action signal 432 corresponds to an operator instruction for atleast one of reducing an intensity of the illumination 540, stopping theillumination 540, reducing the LAL misalignment 410 by rotating the eye;and shifting the illumination pattern 550 to reduce the LAL misalignment410, optionally displaying a proposed corrective shift for theillumination pattern 550.

FIG. 12B shows that in some embodiments, the generating 630 can comprisethe step 633 of transmitting the illumination control signal 430 by theIllumination Controller 400 to the Light Delivery Device 500 that isconfigured for illuminating the LAL 10 with the illumination pattern550.

In some embodiments, the generating 630 can comprise the step 634 ofgenerating an illumination-reduction control signal 434 as theillumination control signal 430, indicating that the LAL misalignmentfactor 420 exceeded a reduction threshold. This can be followed byreducing an intensity of the LAL illumination 540 by the Light DeliveryDevice 500 in response to the illumination-reduction control signal 434.

In some embodiments, the generating 630 can comprise the step 635 ofgenerating an illumination-stopping control signal 435 as theillumination control signal 430, indicating that the LAL misalignmentfactor 420 exceeded a stopping threshold. This can be followed bystopping the LAL illumination 540 by the Light Delivery Device 500 inresponse to the illumination-stopping control signal 435.

In some embodiments, the generating 630 can comprise the step 636 ofgenerating an illumination-shifting control signal 436 as theillumination control signal 430, indicating how the illumination pattern550 is to be shifted in response to the LAL misalignment factor 420having exceeded a shift-threshold. This can be followed by shifting theillumination pattern 550 according to the illumination-shifting controlsignal 436 by the Light Delivery Device 500 to reduce the LALmisalignment 410.

FIG. 14 illustrates yet another embodiment of the Tracking-basedIllumination Control System 600. When the LAL 10 gets misaligned withthe illumination pattern 550, the misalignment factor 420 can indicatethat a misaligned illumination region 580 emerged. The illumination 540could potentially pass by the LAL 10 in this misaligned illuminationregion 580, possibly causing an undesired outcome. The misalignmentfactor 420 indication can cause the Illumination Controller 400 togenerate an illumination-reducing control signal 437 as part of theillumination control signal 430, to indicate that the illuminationpattern 550 is to be reduced, or stopped, in the misaligned illuminationregion 580, to avoid the illumination 540 pass by the LAL 10. Inresponse to this, the Light Delivery Device 500 can reduce, or stop, theillumination pattern 550 in the misaligned illumination region 580according to the illumination-reducing control signal 437, preventingthe undesired outcome.

Another consequence of the LAL misalignment is that a misaligned LALregion 590 emerges on the side of the LAL 10 that is complementary tothe misaligned illumination region 580. This misaligned LAL region 590is outside the illumination pattern 550. For the time period of themisalignment, this misaligned LAL region 590 does not receive itsassigned illumination pattern 550, and therefore, its refractiveproperties are adjusted insufficiently by the illumination 540. Therefractive properties of the LAL 10 in the misaligned LAL region 590 areadjusted to a lesser degree than the doctor planned. Next, steps of amethod will be described to compensate for this insufficientillumination of the misaligned LAL region 590.

Once, in response to the illumination control signal 430, the doctor orthe LDD 500 realigns the LAL 10 approximately, or completely, with theillumination pattern 550, and accordingly the misaligned illuminationregion 580 gets minimized, or eliminated, the Illumination Controller400 can generate an illumination-recompensing control signal 438,indicating that the illumination pattern 550 is to be enhanced in themisaligned LAL region 590. This step is performed in order to the LightDelivery Device 500 to enhance the illumination pattern 550 in themisaligned LAL region 590 according to the illumination-recompensingcontrol signal.

Summarizing the above in terms of method steps, the method 601 caninclude

Generating 637 the illumination-reducing control signal 437 as part ofthe illumination control signal 430, indicating that the illuminationpattern 550 is to be reduced in the misaligned illumination region 580,in response to the misalignment factor 420 having indicated an emergenceof the misaligned illumination region 580;

Reducing the illumination pattern 550 in the misaligned illuminationregion 580 according to the illumination-reducing control signal 437 bythe Light Delivery Device 500;

Generating 638 the illumination-recompensing control signal 438 as partof the illumination control signal 430, indicating that the illuminationpattern 550 is to be enhanced in the misaligned LAL region 590, inresponse to the misalignment factor 420 having indicated a minimizationof the misaligned illumination region 580; and

Enhancing the illumination pattern 550 in the misaligned LAL region 590by the Light Delivery Device 500 according to theillumination-recompensing control signal 438.

Various eye-tracking systems are known in the art. Some of them are usedin conjunction with systems that illuminate an eye, such as Avedro'scorneal cross-linking illumination system. Such existing systems andprocedures typically image the iris or the limbus, and illuminate thecornea using this imaging. It is preferred that the illumination hitsonly the iris after traversing the cornea, instead of the illuminationentering the pupil, because then it would impact the retina. There aresubstantial differences between embodiments of the here-describedsystems 100 and 600, and existing systems, such as Avedro's.

(a) Existing systems track living ophthalmic tissue, such as the iris orthe limbus, whereas systems 100/600 track an implanted device, a LAL 10.This difference has several consequences. For example, the LAL istransparent, in contrast to the non-transparent iris and limbus.Therefore, it is much harder to image the transparent LAL with the sameresolution as the iris or the limbus.

(b) The natural lens of the eye is strongly absorbing in the UV.Therefore, if a UV illumination by an existing system, directed at theiris, gets misaligned and partially passes into the eye through thepupil, the natural lens will absorb it and it does not reach the retina.Thus, the occasional illumination misalignment means a very limitedproblem, and correspondingly, the precision of these systems can be low,tolerating misalignments larger than 1 mm, 2 mm, or higher. In contrast,the LDD 500 illuminates the eye with the natural lens removed. In thiscase, when the illumination pattern 550 is misaligned with the UVabsorbing LAL 10, the portion of the illumination 540 that passes by theLAL 10 can impact the retina unattenuated. Therefore, the precision ofthe illumination pattern 550 of the LDD 500 needs to be much higher. Inembodiments, where the LAL misalignment factor 420 is the LALmisalignment 410, in the here-described higher-precision LAL Tracker 100and Tracking-based Illumination Control System 600, an illuminationcontrol signal 430 can already be generated when the LAL misalignment410 exceeds 1.0 mm, in other embodiments, when it exceeds 0.8 mm, 0.6mm, 0.4 mm, or 0.2 mm. In embodiments, where the LAL misalignment factor420 is the optionally hazard-weighted cumulative dose 426, anillumination control signal 430 can be already generated when theoptionally hazard-weighted cumulative dose 426 exceeds 1.0 J/cm², 0.5J/cm², or 0.25 J/cm².

(c) Another related consideration is that the corneal crosslinkingprocedures are typically performed with a non-dilated iris or pupil,with a typical diameter 2.5-4 mm, while the diameter of the natural lensgrows over the lifetime and can reach 10 mm. Thus, the misalignedillumination that passes through the pupil is largely blocked by thenatural lens, preventing it from proceeding towards the retina. Incontrast, the LAL illumination is often performed with a dilated iris,with typical diameter of more than 5, 6, or 7 mm. Since the diameter ofthe LAL 10 can be 5-6 mm, a substantially misaligned illumination 540can bypass the LAL 10 through a several mm² area to propagate toward theretina. The difference in the pupil being dilated or not is anotherreason why a much higher precision is expected from the LAL Tracker 100and Tracking-based Illumination Control System 600.

(d) Finally, some corneal crosslinking illumination techniques seem touse limited power, as they seek to modify sensitive ocular tissue. Insome cases, the illumination power density seems to be a few mW/cm²,such as 3 mW/cm². In contrast, the illumination 540 by the LDD 500 seeksto modify the implanted LAL 10, and thus can have a power density ofhundreds of mW/cm². In some embodiments, this power density can behigher than 300 mW/cm², in some cases higher than 500 mW/cm², in somecases higher than 700 mW/cm². This much higher illumination powerdensity is yet another motivation for making the LAL Tracker 100 andTracking-based Illumination Control System 600 much more precise.Re-expressing this difference in total doses applied to the eye,existing systems seem to apply a total dose around 5 J/cm². In contrast,the illumination 540 from the LDD 500 can apply a total energy density,or dose, higher than 30 J/cm², in some cases higher than 50 J/cm², inyet other embodiments, higher than 70 J/cm². As before, the higher doseis applied to the eye, the higher precision is expected from the systemto limit even the potential dose hitting the retina to very smallvalues.

While this document contains many specifics, details and numericalranges, these should not be construed as limitations of the scope of theinvention and of the claims, but, rather, as descriptions of featuresspecific to particular embodiments of the invention. Certain featuresthat are described in this document in the context of separateembodiments can also be implemented in combination in a singleembodiment. Conversely, various features that are described in thecontext of a single embodiment can also be implemented in multipleembodiments separately or in any suitable subcombination. Moreover,although features may be described above as acting in certaincombinations and even initially claimed as such, one or more featuresfrom a claimed combination can in some cases be excised from thecombination, and the claimed combination may be directed to anothersubcombination or a variation of a subcombinations.

1. A Tracking-based Illumination Control System, comprising: a LightAdjustable Lens (LAL) Tracker for tracking a LAL implanted in an eye,including an Imaging System, for creating a LAL image by imaging theLAL, and an Image Recognition System, coupled to the Imaging System, fordetermining a LAL position in a reference frame based on the LAL image;and an Illumination Controller, coupled to the LAL Tracker, configuredfor determining a LAL misalignment factor, corresponding to a LALmisalignment that characterizes a misalignment of the LAL position witha LAL illumination pattern, and generating an illumination controlsignal in relation to the determined LAL misalignment factor.
 2. TheTracking-based Illumination Control System of claim 1, wherein: theIllumination Controller is integrated with at least one of the ImageRecognition System and a Light Delivery Device.
 3. The Tracking-basedIllumination Control System of claim 1, wherein: the reference frame isreferenced to at least one of the Imaging System, the Image RecognitionSystem, the Illumination Controller, and a Light Delivery Device.
 4. TheTracking-based Illumination Control System of claim 1, wherein: anillumination pattern of a Light Delivery Device is centered in thereference frame.
 5. The Tracking-based Illumination Control System ofclaim 1, wherein: the reference frame includes one of a reticle coupledinto the optical system of the Light Delivery Device, and a reticleelectronically generated in one of the LAL Tracker and the IlluminationController.
 6. The. Tracking-based Illumination Control System of claim1, wherein: the LAL misalignment factor is one of the LAL misalignment,a retinal irradiance, and a hazard-weighted retinal irradiance.
 7. TheTracking-based Illumination Control System of claim 1, wherein: the LALmisalignment factor is a cumulative dose, corresponding to an optionallyhazard-weighted retinal irradiance, integrated over an illuminationtime.
 8. The Tracking-based Illumination Control System of claim 1,wherein: the Illumination Controller is configured for generating theillumination control signal in response to the determined LALmisalignment factor exceeding a threshold.
 9. The Tracking-basedIllumination Control System of claim 8, wherein: the threshold is awarning threshold and the illumination control signal is a warningsignal, generated by the Illumination Controller when the LALmisalignment factor exceeds the warning threshold.
 10. TheTracking-based Illumination Control System of claim 9, wherein: thewarning signal is generated by at least one of a haptic alarm, an audioalarm, a video alarm, a temperature alarm, a vibrating alarm, and amechanical alarm.
 11. The Tracking-based Illumination Control System ofclaim 8, wherein: the threshold is an operator-action threshold and theillumination control signal is an operator-action signal, generated bythe Illumination Controller when the LAL misalignment factor exceeds theoperator-action threshold, wherein the operator-action signalcorresponds to an operator instruction for at least one of reducing anintensity of an illumination, stopping the illumination, reducing theLAL misalignment by rotating the eye; and shifting an illuminationpattern to reduce the LAL misalignment, optionally displaying a proposedcorrective shift for the illumination pattern.
 12. The Tracking-basedIllumination Control System of claim 8, wherein: the IlluminationController is configured for transmitting the illumination controlsignal to a Light Delivery Device that is configured for illuminatingthe LAL with an illumination pattern.
 13. The Tracking-basedIllumination Control System of claim 12, wherein: the threshold is areduction threshold and the illumination control signal is anillumination-reduction control signal, indicating that the LALmisalignment factor exceeded the reduction threshold; and the LightDelivery Device is configured for reducing an intensity of theillumination in response to the illumination-reduction control signal.14. The Tracking-based Illumination Control System of claim 12, wherein:the threshold is a stopping threshold and the illumination controlsignal is an illumination-stopping control signal, indicating that theLAL misalignment factor exceeded the stopping threshold; and the LightDelivery Device is configured for stopping the illumination in responseto the illumination-stopping control signal.
 15. The Tracking-basedIllumination Control System of claim 12, wherein: the threshold is ashifting threshold and the illumination control signal is anillumination-shifting control signal, indicating how an illuminationpattern is to be shifted in response to the LAL misalignment factorhaving exceeded the shifting threshold; and the Light Delivery Device isconfigured for shifting the illumination pattern according to theillumination-shifting control signal.
 16. The Tracking-basedIllumination Control System of claim 12, wherein: the illuminationcontrol signal includes an illumination-reducing control signal,indicating that the illumination pattern is to be reduced in amisaligned illumination region in response to the misalignment factorhaving indicated an emergence of the misaligned illumination region; theLight Delivery Device is configured for reducing the illuminationpattern in the misaligned illumination region according to theillumination-reducing control signal; the illumination control signalincludes an illumination-recompensing control signal, indicating thatthe illumination pattern is to be enhanced in a misaligned LAL region inresponse to the misalignment factor having indicated a minimization ofthe misaligned illumination region; and the Light Delivery Device isconfigured for enhancing the illumination pattern in the misaligned LALregion by the Light Delivery Device according to theillumination-recompensing control signal.
 17. A method of operation of aTracking-based Illumination Control System, the method comprising thesteps of: tracking a Light Adjustable Lens (LAL), implanted in an eye,by a LAL Tracker, including creating a LAL image by imaging the LAL withan Imaging System, and determining a LAL position based on the LAL imageby an Image Recognition System, coupled to the Imaging System;determining a LAL misalignment factor, corresponding to a LALmisalignment that characterizes a misalignment of the LAL position witha LAL illumination pattern, by an Illumination Controller, coupled tothe LAL Tracker; and generating an illumination control signal inrelation to the determined LAL misalignment factor by the IlluminationController.
 18. The method of claim 17, wherein: the Image RecognitionSystem and the Illumination Controller are integrated; and thedetermining the LAL position by the Image Recognition System and thedetermining the LAL misalignment by the Illumination Controller is acorrespondingly integrated step.
 19. The method of claim 17, wherein:the LAL misalignment factor is a cumulative dose, corresponding to aretinal irradiance integrated over an illumination time.
 20. The methodof claim 17, the generating comprising: generating a warning signal asthe illumination control signal by the Illumination Controller when theLAL misalignment factor exceeds a warning threshold.
 21. The method ofclaim 17, the generating comprising: generating an operator-actionsignal as the illumination control signal by the IlluminationController, when the LAL misalignment factor exceeds an operator-actionthreshold, wherein the operator-action signal corresponds to an operatorinstruction for at least one of reducing an intensity of anillumination, stopping the illumination, reducing the LAL misalignmentby rotating the eye; and shifting the LAL illumination pattern to reducethe LAL misalignment, optionally displaying a proposed shift for the LALillumination pattern.
 22. The method of claim 17, comprising:transmitting the illumination control signal by the IlluminationController to a Light Delivery Device that is configured forilluminating the LAL with the LAL illumination pattern, impacted by theillumination control signal.
 23. The method of claim 22, comprising:generating an illumination-stopping control signal as the illuminationcontrol signal, indicating that the LAL misalignment factor exceeded astopping threshold; and stopping the LAL illumination by the LightDelivery Device in response to the illumination-stopping control signal.24. The method of claim 22, comprising: generating anillumination-shifting control signal as the illumination control signal,indicating how the LAL illumination pattern is to be shifted in responseto the LAL misalignment factor having exceeded a shift-threshold; andshifting the LAL illumination pattern according to theillumination-shifting control signal by the Light Delivery Device toreduce the LAL misalignment.
 25. The method of claim 22, comprising:generating an illumination-reducing control signal as part of theillumination control signal, indicating that the illumination pattern isto be reduced in a misaligned illumination region, in response to themisalignment factor having indicated an emergence of the misalignedillumination region; reducing the illumination pattern in the misalignedillumination region according to the illumination-reducing controlsignal by the Light Delivery Device; generating anillumination-recompensing control signal as part of the illuminationcontrol signal, indicating that the illumination pattern is to beenhanced in a misaligned LAL region in response to the misalignmentfactor having indicated a minimization of the misaligned illuminationregion; and enhancing the illumination pattern in the misaligned LALregion by the Light Delivery Device according to theillumination-recompensing control signal.